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(54) Digital photof inishing system including digital image processing of alternative capture color 
photographic media 

(57) A method of digital photof inishing comprising 
the steps of: producing a digital color image in printing 
densities of a color Image captured on alternative cap- 
ture photographic media; first mapping the printing den- 
sities of the alternative capture photographic media to 
the printing densities that would have been obtained for 
reference color photographic media; processing the 
mapped digital color image with a scene balance algo- 
rithm to produce a processed digital color image; sec- 
ond mapping the processed digital color image through 
a hard copy media characteristic curve to produce a 
mapped digital color image mapped to print densities of 
the hard copy media: sharpening the mapped digital 
color image with a sharpening algorithm optimized to 
avoid unacceptable artifacts; and digitally printing the 
sharpened digital color image onto hard copy media. 
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Description <- ~ . , ... . . ■ . ? ^ ^ o-., 

HELP OF THE INVENTION i : , . ^ , , , \ / 

5 [0001 ] This invention relates In general to digital photqf inishing systems and nrare particularly ;1p a digitqil phptof inisti- 
ing system, selectivetyrincluding film .under, exposure gamma, scene balance, contrast nprmalization, and sharpening, 
digital image processing for alternative capture cpbr ph^^ ; < m - : c. :; / . ; r 

BACKGROUND OF THE INVENTION 

[0002] Sever^aJ problem areas need to be addressed- wheri iral^ns color negative pap color negative.film 

Images. The object of the process is to make a pleasing prlrrt from the filin, image. IJie first problem is to fihd the iWel 
of exposure necessary in a projection printer system to produce^th^t pleasing print Jn the simplest InTpjemerrta^ ot a 
process, one projecte;the color>,negativ5^;.fi!m Image omq^j^ photo^tissnd^e image recetyer.; proce^^ the paper, 

15 and then repeats the, process until ^-pleasing print has been obtained/ frvautqmat?d.phqto-f inishing^^ a film 

scanner reads densities, from the negative arKJ. passes the inforrnation to a computer algorifrim tiiat computes the 
appropriate^ exposure valu^ so that a pleasing print can be^ obtained.: At this Roint . the'conve^ntioral photographic print- 
ing process ends. That is, i{ there are any ren:iaining problenfisjn a photo^^ '"^Sf??; np.ot^®** processes are 
available to reduce the severity of the problem. Problems such as film under-exposure or over-exposure, inappropriate 

20 gamma for a particular scene, poor quaFrty camera or printer lenses, low or high activity of film or paper processes, poor 
scene t>alance, and poor sharpness in the final image remain that we would like to correct or modify. ^ 
[0003] Methods and systems have been described for more than 10 years that are devoted to producing pictorial 
images on various media and devices from scenes captured on photographic filrn, via scanning to produc^ a digital 
image, image processing, and output rendering. Examples include the fo^^ 

25 - ■ ■ . -r' .r, -^^ • ' ^ \ .c :. : - 

• Journal of Imaging Tecjhnology, Vol. 14. ^Number 3; June 1988. Fifth et. al. describe systems that capture scenes 
on fiinri, scan film to produce a digital image, digitally process the irnage. and output via a laser AgX printer. 
U.S. Patent 4.500.919. Schreiber dscloses.an image reproduction system that scans an image captured on film, 
display the image on a video monitor, enables image processing, and finally output to an inke0 hardcopy. , 

30 • U.S. Patent 4,979,032 (Dec. 18. 1^, filing date: Dec. 27. 1988). AiessLet al. describe an apparatus, including a 
film, scanner, a, video monitor, image processing, and output, to produce various output visually matched tb^frie 
image displayed on the monitor. , 
U.S. Patent,.5,267.030; issued Noyenriber SfO, 1993, inventors .Giorgianni et. at and means to 

transform images captured on:fam»;yia, digitization pri^a film scangep^.to a coipr rpetric or other space, with output 

35 onto a variety,pf:iTiedia:ard-devt<^^lJ^^^ the improvemients offered by digital image process- 

ing. including;aesflietically pleasing modifications to the tone and color reproduction as well as, sharpening. 
U.S^ Patent 5,300;381 . ^issued April 5. 1 994, inventors Buhr et. al describe a pictorial imaging system that consists 
of capture on photographic film, filrn, scanning to produce a digital image, irnage processing, and digital output. 
U.S. Patent 5,579,132, issued November 26, 1996. inventor Takahashi describes an image processing system 

40 devoted to storing or producing images that have "substantially the same cpjpr" or additional "aesthetic color.cor- 
rection" versus the original scene, based on a variety of image processing transformations of the digitized image. 
U.S. Patent 5,608.542, issued March 4. 1 997. inventors Krahe et al. describe a system that produces index prints 
based on scanning a film frame, image processing, and rendering. ; i : 

U.S. Patent 4,945.406. issued July 31, 1990, inventor Cok. describes a system for achieving automatic color bal- 
45 ancing of color images by transferring color pixel values from log exposure RGB color values into printing density 
values and generating color correction offset values utilizing a printing density based color correction method. 

[0004]; >i The KODAK 35mm/24mm color negative film format Index Printer, sold by Kodak, produces an index print (a 
matrix of small imagettes) reproduced from individual film image frames. The index print is produced by the photofjn-r 
50 isher when the original. print order is processed, and is supplied to the customer as a conveniecrt means of identifying 
image frames on the film (see: U.S. Patent 5.608.542. above). The Kodak Index Printer uses image, processing Cfp the 
miniature images including:, v r-,- i ; 

digitahimage in film RGB printing density , , : . t , - ; 

55 • applying a scene balance algorithm to balance the digital film printing density image , : 

mapping the color negative digital image onto a color paper (EDGE-type) charaqteristic curve - 
digital sharpening 

rendering using, a- GRTprinter,.ontophptogr^phiG paper / . 
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[0005] In the Index Printer, the above image processing: (1 ) is not applied to full frame images in a digital color printer; 
and (2) ^ not applied to high resolution inrages in a digital color printer, only low resolution images. 
[0006] U.S. Patent 5.134,573, issued July 28. 1992, Inventor Goodwin, discloses a method for increasing the range 
of values representing a color Image which exhibit a linear response. The toe and/or shoulder regions of the film's three 

5 density W log exposur^^ ■ - ' 

[0007] U:S. Patert ^.oi2;S33, isSued'April 30; ii991,^inventDrs Lee:et al., discloses a dyh range adjustment sys-: 
tern for printing digital images based on visual phbtbreceptor adaption ^nd hiimah visuaf contrast sensitivity. The sys- 
tem adjusts the contrast of the low frequency component only of the image, preserving the high frequency component 
in its contrast. . f- : ^ - . \: 

10 [0008] All of these articles or patents describe, in one form or another, processes for obtaining more pleasing prints 
from a f flir* image caprture than the i:»nventiohal opHc&l process; There is thiiis a neled ifor a sofutibn to these problenr^" 
which can b^ incor^M ^: . . r/^-.. r . v. : > • t; ; 

[0009]* While it' is sti^^ht-fen^ to produce high^juallty' im^^ fi'orfi high-quality nriedia d^ standard 
optical-printirig photo-firtishlhg oil hfgh^u^lity' color ph^ using hi^-cfuaifty^GhenTical processing and 

15 printing equipment that is prdfierly run; it'^wbufd tie beh'^lcial t6 prbduce hij^h-qiMllty irhages f rbftv ca^ that^ 
would hot produce stich results using the same optical plrinting'photo-finishTrig path. Such light-sensitive media might 
be lower in cost or linstdhtable for bpScaf prirrtirig; and' use cohventionaJ cheftticar'prbce^'ng;* ^ternate chemical 
processirig, or other non-traditjbreJ image dbvelcprnfeht^ ats that uised in instant photography or af^ied 
heat without iicjuidS. ]^/.^ '\ --L-rx. ■■- ^ ^ / . ■ ' '■'"^ 

SUMMARY OF THE llsiVENTldN ' ' ■ ^ : 

[0010] According td the presferrt irivention, there is provinded a soluti^ ^ ' y-' - 

[001 1 ] According to a feature of the present inventiori, there is provided a method of digital photofinishing comprising; 

25 the steps of: producing a digital color image in printing or other densities of a color image captured on alternative cap- 
ture photographic media: first mapping the printing or other densities of the afternative capture photographic media to 
the printing densities that would have been obtained for reference color photographic media; processing the m€tpi>ed/ 
digital color image with a scene balance algorithrh to produce a processed digital color image; second mappirtg tfie 
processed digital color image through a hard copy media characteristic curve to produce a mart^ed digital color image 

30 mapped to print densities of the hard copy m^ia; Sharpening the mapped digital color image with ^ sharpening algo- ' 
rithm optimized to avoid unacceptable artifacts; and digitally printing the sharpened digital color Im^ge ohto hard copy' 
media. ' ' ' 

[0012] According to anSthef feiature dftiie present inverrfibn. there is provided a method of digital photofinishing com- 
prising tiie steps of: prbduting ;a cfigilal ik>\br ne^gatVelJ^hagfe" iri bpticaf or otheppriritirfg densities o^ gjoI^ image-cap- 

35 tured on a color hegativi photographic element wliich is optimireci fbrproduciri^^3 dDldi^ihriage sD'rte^ 

an electronic form arid subsequefnt f econversibn into avievfvabl^form; mapping tiie printing densities dftiie-digitalcolor 
negative image to the printing densities tiiat wbiiid have been obtained for the reference color negative photographic 
element; processing the mapped digital color negative image with an underexposure scene balance algorithm; map- 
ping tiie processed digital color negative image through a hard copy media characteristic curve to producfe a digital 

40 color positive image; sharpening tiie mapped digital color positive image with a sharpening algorithm optimized to avoid 
unacceptable artifacts; and digitally printing the sharpened digital color image onto hard copy media. 

ADVANTAGEOUS EFFECT OF THE INVENTION 

45 [0013] The invention has the following advantages. ^^^^ - L v c . - \; ; on 

1. A digital photofinishing system is provided that produces high quality digital photographic reflection prints from 
alternative color negative film images tiiat match thosethait wbUld have been obtained frohi^ reference^fJlm at high- 
print rates. • •* :i-> ■ • - i ^ i':-' f.:.'' : ■•: . ■:■ ■.• _ - ^r.. : \: ■ 
50 2: Sharpness tiiat is difficult to correct in conventibriaf optical photcffinrshfrig systems is'corrected by digital^ image 
piocessfncj in a digital photofinisher. - ^ : - :.'.:., i v; 

3. Prints produced by the digital photofinishing system of the invention were prefen^ed over prints produced by opti-v 
cal photofinishing systems. 

4. Prints produced by the digital photofinishing system that have improved overall print contrast frombolor films neag-^ 
55 atives that are under-exposed. ' ' .jr^'K;;.. --^ . r\J. - . ^ r ^i- 

5. Prints produced by the digital photofiriishing system that hsrVei 'a preferred im^ge contrast position relative to a^ 
tracfitional optical print ^ / " 

6- The contrast normalization algorithm improves quality of low contrast scenes by mcreasing inriage contrast and 
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of high contrast scenes by decreasing image contrast. 

.7r Improves quality of prints prpduG,ed from low activity film and/or paper cbernical processes by increasing tfie print 
^contrast..': . • • * V- ' ' '■■ -\ -i.-. - r .-^x.'.r. '[\r-: 

.8. Improves quality of p/irit^ produced from, high activity film and/or paper <;hemicaLproce5ses,by decrea 
5 print pOTTtrast . -w.-.— r ^ctL • : ■ >;, ^ .>r^ -..-^i , 

BREEF DESCRIPTION OF THE DRA\AnNGS , _ . r ^ ^: - 1; t 

i Rg: 1 is] a block diagram o* a^djgrtal photcf inishing systern iricorpprating Bie preserrt Jnyenti ^ y-. ^ ■ . r : 
Rg. 2 is a flow diagram of a preferred method qf.the present invention.^ , . ? - ^ : . - ^ , : i 
Rg. 3 is a graphical view useful in explaining aspects of the present Invention. 

75 DEHNmON OF TERRAS " ' , ^ 

[0015] The term "reference color photographic media" is'usedto indicate. coriyehtional color negative film developed 
through conventional color negative film processing which is used to produce a color image on conventional color pho- 
tographic paper using optical printing photofinishing. 
20 [001 6] The term "alternative capture color photographic media" is used to indicate one of the following. 

1 . A color negative or reversal photographic element fo?; producing a color irnage suited, for conyersioato an lelec- 
tronic form and subsequertt rsconyersion into a vjewatjleform comprised of^a support and, coated on ttie support? 
a plurality of hydrophilic colloid layers. including radiation-sensitive silver halide emulsion layers, forming. layer units 

25 for separately recording tilue, green, and red exposures, each of the layer units containing dye image-forming cour 
pier chosen to produce image dye having an absorption half-peak bandwidth lying in a different specta^l region in 
each layer unit, wherein the layer units are substantially free of colored masking coupler, the layer units each exhibit 
a dye image gamma of less than 1.5. the element exhibits an ^cposure latitude of at least 2.7 log E. where E is 
exposure measured in tux-seconds. 4nd wherein the gamma ratio for each of the blue and red color recording units 

30 is between 0.8 and 1 .2. 

2. A color photothermographrc elfement that is thermally processed. Specific examples of multicolor photothermo- 
graphic elements are described by Ishikawa et al. in European Patent Application EP 0726201 A1 . 

3. A color photographic element processed by instant prbcessing techniqt;es. t. ' / 

35 DETAILED DESCRIjf>T1pN OF <THel^5VEN7^6N 

[0017] Referring to Rg. 1. there is shown a block diagram of a digital photofinishing system 10 incorporating the 
present invention. As shown, system 10 includes a digital scanner 12 for scanning color photographic media 14 to pro- 
duce a digital color image of a cpior image frame 16 on color media 14. Color media 14 is a negative film. Image data 

40 manager 18 processes the digital image to optimize the image for printing the processed image by printer 20 on color 
hard copy media 22. Color hard copy media can be any high quality reflection or transmissive media, such as silver ttal- 
ide color paper, and media used in ink jet. thermal, electrophotographic printing processes. The operation of scanner 
12 and prirrter 20 are described^^ in greater detail below. .r = n , ■ ; 

[001 8] Image data manager (I DM) 1 8 processes the digital color^irnage from scanner 1 2. 1 DM 1 8 js preferably a digital 

45 conrput^r having user input 24 (keytx>aFd. mouse) and cornputer readable storage rnedia input 26. Computer readable 
storage media may comprise, . for example, ymagnetic storage rpedia. such as a rnagnetiC;f loppy disc or magnetic tape; 
optical storage media, such as optical disc, cpticai tape or machine readable bar code; solid state electronic storage . 
devices, such as read only rnemory (ROM) or randpm.access memory (RAM); or any other physical device or medium 
enployed to store a computer . program. The.digitaMmage processing techniques, described below can be stored, pn , 

so readable storage media. Alternatively, some or all of the techniques may be incorporated into programmable gate, 
arrays or other hard electroriic devices. ^ , - . r : : : ■ , . r : i 

Scanner 

55 [0019] The scanner 12 for the production of digitally processed prints scans, a 35 mm full frame image at a minimum^ 
resolution oiimx n pixels.- It would .beprgfeiTed,thaT .the:Scanner^ a higher image resolution of. e.g.. 2m x 2n 

pixels so that "panoramic" images or enlargements can be printed with sufficient resolution without interpolation. The 
higher resolution is also preferred for the preparation of 5R prints. All magnifications higher than 5R will require higher 
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resolution scans. • - ' . _ : 

[0020] h is preferable that the scaniier deliver ttie digltiied data to the ihiage prbeessihg' algorithm ds "printlnglden- 
sity." A scanner that measures printing density has red. green, and blue effective spectral response that matches that 
of photographic paper iri an dptical printer. Photographic filr^^ for 6pticaT|Snrttjng ar^idesigned based oh the 

expectation that the captured information in the film will be read by this type of red, green and t>lue spectral response 
characteristic. " 

[0021] Even though the scanner is not considered part of the digital image processing path, some riiahipulatidns of- 
the data may be required to deliver "printing density" to the processing algorithm. Two key steps are converting scanner 
densities to calibrated scanner densities, and converting the calibrated scanner densities to printing densities. Matrix 
operations may be required to perform these conversions. 

[0022] The f irst step ifi the process is to cbtwert the raw scanner numbers to calibriat^ scahner.densities. If a matrix 
operation is used, an appropriate matrix correctibriWc^ ■ ' - ' ' ■ '~ v ; . - 
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is raw scianner number and D^yf' is cdfrected Sinner density. ' - 
[0023] Th^^n^ process in the scanner doriverts calibrate sciariher densities to caiibrkted prihtirfg densrti^ 
process is implemented again with a matrix model that in this case can be up to a6 x .10 matrix rtiultiplibat*K>n:;An 
pie is shdwn below. ' ' ■ - ^ ^ ' " ' - ' " ' > - 
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The output of the matrix multiplication is calibrated printing density, ^sjf is calibrated scanner density, and Dp;^^ is cali- 
brated pi^^intirig density. Either or both of these'steps can'be implemerrted with a 3D look-up-tabie. ==i • 'l * 
[0024] If the scanner tioes not measure "printing densities" directTy for tl^'%lternate capture rtiedia, the "scanner den-- 
sities" produced by the scanner can be transformed to reference firirrtihg^ensities fbrlhe alternate capture film as the^ 
first i^tep in the ima^e processing. Alternatively, the scahherdehsitiies fof*the alfer^ capture media-may be passed-* 
to the Image Data Manager if tiie irhage processing parameter ran accorf^ input type. These pathways per- 
mits bsihg 'specially designed alternate c^ture media arid Scanners Ihiat result in identical Imag^ to those that would 
be obtained with tiie reference media and "printing d^sity" s<fdnhers?:' ^ > : - w ^ , >^ 
[0025] Fig. 2 is a flow diagram of a general image processing system for digitat photofinishing incorporating the/ 
method of the invention. The diagram is divided into several sections: digital image acquisition (box 30). the analytical 
section (box 40) performs analytical evaluations to pr^are shift values for color and density balance, and tone look up 
table preparation for control of final print contrast. This information is then F>assed into the processor section (box 50) 
of the nhddel to prepare the digitizedfilm image for printing Section ^ . ^ ^ . ' i^i'- 
[0026] ' In the image acquisition section, an irnage on phbtograpfhic media (ti€gative fnm>(box 32) is scanned (by scari^ c 
ner 12) toproduce a full resolution digital image" (box 34); = ' ' ' - :-'-'.v . . - : . i* cl 



EP 0 961 482 A2 



Conversion to Reference Media Printing Densities ^r : 

[OOZJl .Thje first step in the image processing is to convert the densities produced by the. scanner from; the spanned 
attern^e. capture, photographic niedia to the printirig densities that woufd have been produced from the reference color 

5 photographic media (box 36) .This is accomplished by applying a conversion nriatrix or 3DJpok-up table40;the pixel den- 
sities in the captured image. . f ^ : - , t . J V 
[0028] The conversiorif matrix or 3D look-up table can.be createfd.byvSubjecting the alternate, capture media and the 
reference media to the sanrie-seiof exposures.. The ejqx>sures are selected to sarnple the exposure range 4hat tfie 
media and- reference media ^ould. experience green, and blue Response ctiameis^^y^ used for image 

10 capture in the marketplace' To provide an accurate density conversion, it is recommended, that at least 70 different 
exposure, values be used.tq create the densities for the films that will be used to,c^lculate.the matrix or:^3D.look-i4) tat)le. 
using regression^echpiqii^ or lopk-qp table populating techniques (for example, U.S. .Patent 4,94t,039). After appro- 
priate chemical processing qftiie reference .media, and appropriaje.chernical or other proce|SS|ng of the alternaflve cap- 
ture media to be used, the densities for the alternate capture qriedia^aire ipeasured usipjg the spectral re^sponsiyities, that 

15 represent the densities that will.be transrnitled„ to tfie Ifriage Date Mapager 1 8, and. the dex^sities for the^ referenpe media 
are nneasured in reference printirig densities. A matrix or 3D look-up t^l?l^ is calculated from this data ttiat maps.the 
alternate capture media densities ;t6 the printio^^ . 
[0029] The preceding paragraph d^Bscribes, the preferred method 6* converting the densfti^ from a, specific alternate 
capture media to a specific reference media. For convenience, it may be necessary to map several alternate capture 

20 media densities to one reference media. In this case, approximate conversion matrices and 3D look-i^x tables may also 
be used to effect the density conversion from alternate capture media to reference capture media, with somewhat less 
resultant print quality. These parameters may be obtained for similar alternate capture or reference capture iraterials., 
[0030] A more preferred method for image pixel density conversion from alternate capture njedia to reference , capture , 
media incorporates th^ application of red, green, and l^lue channel 1 D look-up tables prior to and/or after the application 

25 of the matrix or 30 look-up table.-Tl:>e .1 D look-up tables can be used to^correct.gross differences in the characteristic , 
curves for the alternate and reference capture media.. . 

[0031] . . In principle, the cdnyeirsiqn from alternate ,rnedia capture densities tp reference media printing densities could 
be n^de^ different points in the image processing change. Hpfwever. the preferred location is prior to the Analysis step. 

30 Analytic;^ Section . , ,y . ■ 

[0032] The image process begins with the digitized film image. The image, with a minimum resolution of m x n pixels,^ 
may be sampled doyvn to a m* x.n:.pixeMrpag0.,tat is analyzed by, a scene balance algprilJirn (SjgA),. and a corjtr^^t norr ' 
malization algorithrn. This inforn^ion is passed to^the prqcessp!; sa^^ the algorithrn ,sp,that the full resolution 

35 image, or any other; sub^arp^ 

[0033] The analysis phase determines a set of shift, values, to be.added to the digitized pixel values, that are neces- 
sary to assure that the final print^densities will be .appropriate. The scene balance algorithm determines a set of der^- 
ties that represent a form of ^'average densrties**, that are compared to ^ known set that produces a pleasing print. These 
numt>^s force the- digitized image to print to the proper print density and color balanca The average densities are sub- 

40 tracted from the assumed gray density point qf the paper look-up table to^give shift values that will mpdity the image. to 
prodqce a pleasing print for density and color balance. Next, the sub^sampled image is evalua|ted and. corrected for 
unde?,exp9sure (box 48). . . . . , - : 

[0034] , The irnage is shift^ to c^ new Df„j„ position so that the correction process produces no negative density values. 
A look-up table is applied, to the sub-sampted image such that low film gamma information that is contained in the toe 

45 of the film sensitometric curve is changed in density to increase the gamma. The image is then shifted back to the orig- 
inal Dmin position (the two "shift" operations complement one another). The technique disclosed in U.S. Patent 
5,134.573, issued July 28, 1992, inventor Goodwin, can be used. The shift values are then applied to the full resolution 
digital colcjr irnage (box 46). i , : - 

[0035] Fi pal ly, the sub-sampi ed imag^ is .analyzed^ using the? contrast norrnalization algorithrn (box 46)- The algorithm 

so produces a look-up table that is used^to modify ^e printing density. values of the image in a:Way that produces final print 
image«,with a more pleasing contrast. TTie JcqK-cip table jdoes;the slope correction in "t-space" luminance, the, metric 
used by the.scene balance algorithm. The tone scale rpodification is a two step process: first is the rotation to l^space" 
followed by the.actual algorithm that produces the look-:up tablp. (See: U.S. Patent 5.012,333, issued April 30. 1991 . 
inventpr?. Lee et al.) . ^ . ^ . : , « .r.-:' \ • v • ■ r . 

55 [0036] The analyticaf section produces two items that are sent to the processor section of the image processing algo- 
rithm; tiie conputed shift values an^ , . 
[0037] , /the.lppk-up table .used tuy the algorithrTi may^be a uniyersai table for all media types and conditions. Or it may 
be a function of media type, lab preference, or customer preference. If it is a function of media type, it may be accessed 
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based on the DX code on the media. . . . ' ^ . . • 

[0038] The look-up table that is applied to correct the gamma of the capture media in the under-exposure region may 
be obtained from at number of diffefrent sources. The look-up'table may be encoded optically or magnetically on the cap- 
ture rtiedra. The loofcnjp table may b€i cafculated by the software from reference ' eiiposure 'patches' bri thefcapture 

5 media! *M6diia reference exix«Sure i^^^ in U.S. Patent 5.649;i260. Thelbdk-up table or look-up table 

precursor data may life encoded on optical, magnetic, or other media that accorrpany the capture media. The look^-up 
table may be selected or sufjplriki; dibctly Or indirectly, by the custdmer 6r processing lab. thfe look-up table may be 
accessed from'a sdftw^au^e ennbb^ basecl dh the' media type, lab pireferencer or customer preference. 

The look-eip taWe may Slsot)'elScces^ via the intranet froni an available repository, bksed^dh tfi'e hiedia type, lab pref- 

10 erence.br ojistomeiriDrefferenceL ' ' " ■ ^ - ' - ^ . : ; \. 

[0039] US. Paterit 5; 13i,5?3 loaches the'calculation of correction )6ok-up table with a fiWiitmg gamma enhancement 
value toiavoid tinwkht^ hbiise irrtrbduction. vVe^ave found that it is firefei-able in some ca^es'to catcCilate the correction 
look-tip table as- a ifrac^fion. si^^ of the Qarrthia adjusfmfeht f^dbr 'th&t is required to fuily correct the m^ia toe 

gamma tb' rfiatch that of the media' in' k ndrrhaliy eSqpbsed fegioh. ' ' ■. ^ ■:■ ; . v ■ 

15 [0040]' ~ in the'absence oT art lexpbsureMensity^^ bn the specific 'media proVidinig the image thai' 

are being processeS; the Ibbk^iip table itiay be derived from drffereft respbnse ajDproiirnates^^ such as rriedia aim 
sensitometry. In general, in the absence^bf custorriePprefefehc6 higher 
quality images, and the rHost prefeir^ are frie mfekfia-^fe population av6ragfes for the procesdhg lab. ^ ' ■ ■ ' 

20 Scene Balance Ma(ipi rig ~ ' 

[0041 ] The prbcess of operating a two stage ^ilm/media prihtirig system has as its most irhpdsing task that of finding ' 
a density value on the film e£4)o^ure^nd niapping the densities on that nei^tives to the media so that the besf dVerall 
density and cdlbr balance are obtained. The process is best illustrated by tying together a series of reference pbint^ ' 

25 showing the connections from a scene object to the photographlb reproduction of the bbjebt" 

[0042] Fig. 3. below, illustrates the concept of density tie points in our analysis of pririting proce^: This "processiieis/ 
an Inftial target, usually a uniform gray card, tb'the photographicYeprodudion of that target Test points ai-e established'- 
for the initial exposure of tffe target object as an expected reference film dfehsity from a fBm reference e)q30sure for the 
test object. The quadrant labeled "Printer" merely reflects the film reference density to the log exposure axis of the 

30 media. The test target will be assigned a density to be achieved for the reproduction of that object, or a' density at the 
paper balance point. This point is characterized as the rriedia reference exposure value and a media reference density 
value.' *'-»•-■■"'■-'''■ -'n,'. ■ ; * - . . . :^ 

[0043] ' the objective of t^ balance process is to first determirie the film densfty Value for the film reference 
exposure 4nd to determine the^d'iff^en^^^^ media reference exposure-value. The' 

35 difference, or A, is added to the film reference de^hsity. thig p^d^Jes^ ii^ure^ ihaft \He qiSaraht labeled"^Pr1nf Through" ' 
will yield the appropriate prfnt-density iri the final reprbdudti ■ - n -'i^i.:!::; • r .' . { r r- 

[0044] Real photographic bfportunities. or images, usually do not cdntain test objebti that can be mapped iri a formal 
process like that just described". Scenis balance ajgoritfftns are designed to perform the! task of estimating the reference 
film density, as if a* gray card haid been-induded in thie ^ehe. Once an estirtiate of the film reference density hais been 

40 made, the process is duplicated just as described above. The exarhples show bnly one color record. Color filnte contain 
three i^ecords to capture the red, greea'and blue information from a scene. Thus, the scene balance algorithms itiudt " 
perform two tasks. Rrst estimate the overall density of the film image to that the best neutral density is obtained in the' 
final print, br print through quadrant of the scene. TlVen th 6 balance between the red, green, and bluie exposure must 
be estimatied.' ' ' ' r . • ^ - . 

Image Processor Section (box 50, Rg. 2} ^ . ; v : - , ' i 

[0045] The first step in the proposed image processing algorithm is deep under correction (box 52): A shift in the print; 
ing deniBity data is perfdrmed sb that a single column tablcPcan be used to shift the tisd. green, and'blue pixel densities! 

50 In this iristance. the red, green, and bliie pixel printing density' values are ^djusVed sb'that the film minimuhri densities ' 
values (Dpnin) are all 0.5. All of the digitized data "then is nricidified by ^ table Ibbk-up prbcess such that ^mage densities'- 
that occur near or in the film sensitometric toe region are actually Teduced to increase the image irrfornriatioh gamma/ ■ 
The table consists of a single column of nunibers. The column rieipreserrts the substitution vdlues for the red. green and 
blue pixel values. In the final step of the gamma correction process, a shift is applied that restores the density values tb'"' 

55 the previous unnbrmalized DmiH values. ^ • ^ = ; • ; . .? — . . o . , \ > . f *; . 

[(K)46] The scene balance shift values are applied tbthe printing density vialueis" (box"54). These va!c/6s r&preserit the '''' 
shift (add to the red, green, and blue pixel values) necessary to achieve h print th^rt has'the cbrrect'colbr balance and *^ 
density." 



7 



*jQnrr:rt> *-crp 



EP0 961 482 A2 



[00471 ;, Next, thetone scale Jook-up table from the.analysis procesis is applied to the image (box 56). The image must 
first be.rotatecj to 1-space** since the best tone scale resulted (image quality) are achieved when done .on the jurninance 
information. The matrbc Lspaae,mat is used in this process. . ^ - v.- v , - := i..; 



tjspace.mat 



1/3 1/3 1/3 
•1/4 1/2 -1/4 
1/2 0 ,1/2 



Lspace_//7vc/nat 



-2/3 -1 
4/3 0 
-2/3.1 



[0043] ; After the tbne scale Ipqk-u table has be^n applied to the image, the image da^a is rotated back to printing 
density space usingcthe matrix t_spaceJnv.m3L i ' " ^ \ ^ 

Printer Section (box eiO) ' ^ . . L . _ _ V T . , ! . .. > 

15 [0049] The next step Tn the process is to n^^:the balanced 'image" through hard copy media (color photographic 
paper) characteristic curve .(bQx.62)i The printing density values of the balanced image are mapped to the appropriate 
print density values for negative photographic print paper The finished process produces an image that is color and 
density balanced, and in a print denjsity metric! ^The photograpHic paper curve"; is balariced : c 



20 



25 



30 



35 



Unsharp lUlasking Pirocess • :.f . . * _ 

[0050] The final step prior to actually printing the image is the sharpening process (box 64). An unsharp masking algo- 
rithm is applied to every image just prior to printing. The unsharp masking equation is as follows. I 

I D^(jr)="D(x) + p(D(x)-Jq>(^)D(r-?)cg) 

In this equation, DJky is the "sharpened" denisity at position x, D(x) is the starting density at position x. the recom- 
mended i^alue of p is 2.'5. and the integral values at each pixel position are computed by convolving the image with the 
kernel, betow. - ^ j - . „ 





'0 




5 


I 


0" 


"j r 1 


\ 








'% 




'S 


-38"- 


60 


-38 


-s' 


325 






38 






1 


21 


21 


1 




0 


1 , 


.5 


\. 


0 



The red. green, and blue images are all sharpened to the same level. 

[0051] The recommended .value for p was established by adjusting the value upwards until pictures, when printed, 
began to appear with unacceptable levels of digital artifacts. These artifacts appeared as ringing, or halos. on edges 
yielding images that appear unnatural. 

45 [0052] This value of beta is then applied to a square wave target to measure the modulation transfer function for the 
final processed image. The test to establish the full system MTF response is as follows. First, a target is photographed 
using a color negative film. The original target has a square wave pattern of approximately 40% modulation, The spatial , 
frequency response values for each frequency. of square yyave pattern is 1 00% through all of the system visible frequen- 
cies. The f ilm^image was scanned on the djgital.scanner to produce^a 1024 x 1536 pixel digital image for subsequent 

so processing. This: .image was processed through our SBA plus sharpening path and printed. The spatial frequency 
response of the^final print was measured with a high resolution microdensitometer. and the data analyzed using a har- r 
monic analysis process-Table 1 lists the red. green, and blue response measured in this test (average of four sannples) 
and represerrts the. maximum MTF before significant artifact prpd 

[0053] The MTF curve measured using this process represents the maximum spatial frequency of any digital proeess- 
55 ing system for.Digital Phptof inishing; This as the final- print Jnriage i? a combination of camera lens. film,, scanner, algo- 
rithm, print engine, and print media. Any combination of these elements that yields and MTF curve of this result or any 
result below the values listed in Table 1, will be considered as part of this invention. The set of parameters considered 
for this system, including the sharpening algorithm, are :the maximum level of boost before going into a condition of 
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oversharpenirig. Values of beta; Icwer than that specified in thfe report are considered within the scope of this invention 
because these values also deliver prints that meet our printing requir^ltients for making digifal prints.- If one of tbie sys- ' 
tern connponents is changed, then the beta value will be changedto assure that any-final image produced by this digitaK 
path will achieve the upper limit MTF curve. 



Table 1 



Maximum MTF Values 


. Freq ^ , Red 




...... . 


0.0 


1.0000 


1.0000 


rrl.OOOO. 


0.5 


0.9813 


1.0500 


1.0785 


1.0 


0.9680 


1.1180 


1.1423 


-1.5 


/q-x. - 0.87351 J ; ; ■ 


• * ' t.d840 ' " 


' 1.0948*^^ ^ 








. , . 0,9298 


2.5 


^ ' 0:5263 ^^ -^ 


' - oy^70■ ' ^ ■ 


■ • ^:7-i70 ' 


3.0 


0.3523 


0.5380 


Q.5238, 


3.5 


0.2225 


0.3970 


0.Z12S 


4.0 


: ^ 0,1 5ib 


0.2910;.: 


a2€»8. 


4.5 


0.1150 


0.2140 


0.2023 


5.0 


0.0893 


' 0.1610 


0.1593 


5.5 


0.0690 


0.1250 : 


0.1308. : . 


6.0 


0.0530 


0.1000 ~ 


0.1095 ^ 


6.5 


0.0410 


0.0840 


0.0945 


Notes: 

(1) The column labeled "Freq'* is spatial frequency in q^cle^mm^on a 4R reflection print and the columns 
labeled as colors are the response values fot that color at e^ch spktia! frequency. 

(2) The MTF values are given for a 4" x 6" print, 250 d8ts pSrinck **and 1024 x 1536 pixels. 



[0054] Psycho-physical experiments were conducted to compare these.digital path prints to a convention optical print- 
ing path. The optically printed images were prepared using a-CLAS 35 optical printer running in the full order printing 
mode, thus emulating the SBA operating in our digital path. The scene balance algorithm parameters used in the digital 
and optical paths were the same so that similar prints could be prepared. Pairs of prints, digital and optical, were shown 
to a panel of three judges who were asked to choose frie best print frorri the pair. In 75% Of the pairs, the digital pcM 
was selected, citing sharpness 3Es tfie reason. The remairaing 25% were the optical prints Selected because of grairi 
build-up iri the digital printsr ' - ? i ' ^ ^ . ' • - ' 

Printer . ■ *^ . 

[0055] At this point in the process, the printing densities should be fully balahdsd j^rid correct^. This image informaiT . * 
tion can be printed through a sirrple printing density to print density look-rup table; f i= • - : . ■ ; 

[0056] In the simplest case (printing density to print density),' the printing: density values are mapped to the opproprl-" 
ate prim density values for a positive photographic paq^er. The f irtished-proce^ produces an ihiage that is cdlor and 
density balanced; Jand ina print density metric. We find the most preferred.rhapping from the balanced digital- color neg-- 
ative image onto the characteristic curv^ of the aim AgX papier r*esults from rhapprngreferencer RGB printing densities 
representing an achromatic middle gray onto achromatid RGB'paper densities. These RGB paper densities are a tunc- ' 
tion of the print material irtiage dye specti^. u^r ^^^^y^c?:- : . >i: v c * v • m ^, 

[0057] . The final step prior to actually printing the image is the sharpenin&'^proCeste virfiich has been described previ- . 
ously V- ■ ■ \ . • ' • - c . : ^ V; ^^ .i'jr;iM' ..■.( .3 - - . ■ ^ 
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[0058] At this stage in the process, the encoded data is sent to a printing device that renders, or digitally prints, the 
information on hard copy media {box 66). A calibration process must be operating on this device such that the code val- 
ues presented.to the printer yviil yield t^^^ . ^, ... . 
[0059] Hard copy media, includes, media optimized for the piint technology used, i^e.iJasen or,CRl; photographic print- 
5 ers, ink jet printer, thermal printer, electrophotographic printer, etc. 

Printer Calibration . . ^ . ' - - i i.-' 

[0060] . Prints calibration wijl.be done as part of the image processing systern rriajhten^npe^ such th^t test patch der>- 

70 sity differences between measured and expected densitiiss of less than 0.01 are pbtained..,The simplest ernbodiment 
only requires a neutral scale calibration. In more complex applications, a color calibration may be necessary 
[0061] . A series of uniforn) patches (at least 18) spanning the full range of pririter cpde values are^ printed thijough an 
initial calibration LUX Ttiis^initial LUT mi(st cover all those D/A cpurrt yaluisis that produce de^nsit/ on the print. The patc^i 
densities on the print are measured. With the initial LUX the list of code values, respectiyQ.derisities of those patches. 

r5 and the aim curve, a new calibration LUT can be calculated which should modify printing behavior according to the cal- 
ibration aim. ^ ... ::7^ u t = : ;v; I . ' ^ 
[0062] It will be appreciated that image sharpening can be effected at other points in the Image processing chain. It 
will alsp;be appreciated tiiat the goal of jthe image prppes^ing described, herein is to produce imacfes via digital printing 
that are sirriilar to, or better .than, image? prQ|;Jucec| by optically,printing negative ,f ilr^ images, this can be done in a 

20 Straight forward nr>anner as described herein when using digital hard copy media haying similar image dye spectra to 
the image dye spectra of the hard copy rriedia (silver halide color paper) used In pptipal printing,. i 
[0063] In general, scene contrast mocfif ication algorithms eoritain adjustable parameters that provide a mechanism to 
improve the algorithm results for specific spen^. for. specific, capture media, and/or for specific customers. .These 
adjustable parameters may be fjxed for a specific software version ernbodiment of the algorithm. Or they may be 

26 obtained by the software embodiment of the algorithm from different sources. They iray be encoded on th^ capture 
media optically or magnetically. They n>ay be encoded on optical, magnetic, or otiner rnedia that accompany the capture 
media. They may be selected or supplied, directly or Indirectly, by tfie customer or processing 1^. They may be 
accessed from a software embodiment database, based on the film type, lab preference, or customer preference. They 
may also be accessed via the intranet from an available repository, based on the film type, lab preference, or customer 

30 preference. . . ^ 

Claims ■ ■ , ' ^ ' ,^ ^ 

1 . A method of digital photof inishing comprising the steps of 

35 

producing a digital color image in printing or other densities of a color image captured on alternative capture 
photographic media; 

first mapping said printing or other densities of said alternative capture photographic media to the printing den- 
sities that would have been obtained for reference color photographic media; 
40 processing said mapped digital color image with a scene balance algorithm to produce a processed digital 

color image; 

second mapping said processed digital color image through a hard copy media characteristic curve to produce 
a mapped digital color image mapped to print densities of said hard copy media; 

sharpening said mapped digital color image wrth a sharpening algorithm optimized to avoid unacceptable arti- 
45 facts; and 

digitally printing said sharpened digital color image onto hard copy media. 

2. The method of claim 1 wherein said producing step produces a digital Image in printing densities of an image frame 
captured on traditionally chemically processed color negative or reversal film of nonconventionally chemically proc- 

50 essed color negative or reversal film, thermally processed color photographic element, or instant processed color 

photographic element. 

3. The method of claim 1 wherein said producing step is carried out using a digital color scanner 

55 4. The method of claim 1 wherein said processing step processes said mapped digital color image with an underex- 
posure gamma correction in addition to said scene balance algorithm. 

5. The method of claim 1 wherein said processing step processes said mapped digital color image with a contrast nor- 
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malization algorithm in addifeon to said s^^ i . <. 

6- The method of claim 1 wherein said processing step processes sard mapped digital color iitiag^ with ah uriderek- 
posure gamma correctfon algorithm and a contrast normalization in additioh to said^cene balance algorithrh. 

7. The method of cikim 6 wherein said processing step includes the steps of creating a subsampled digital image of 
said digital image, processing said subsampled digital image (1) with an underexposure gamma correction algo- 
rithm; (2) wrth a scene balance algorithm to produce density shift parameters which are applied to said full digital 
ima^e to produce a scehe balanced digitaj inra^ c6htr^6t'ri6rrt6HzatioH kld|orithm to produced tone^^ 
scale look up t^ble (LOI^^ : 'v; ,r - ; . 

8. The methbd of dairfi'l Whereini in'said Seconrfn^a^ Jstfep? daid hard"copy'rh6dia i^^ paper and said 
hard copy mkiia chaiBCfferi^ic'dir^^^^ phcrtographic'psijbrfer thfarac^^ and wherein in said printing step 
sardharbcop ^ - m^ v : ; . - -i , . : . 

9- A method of digital photofinishing comprising the steps of: ^ 



I a drgitali cdlbr hfeg^tive iririage rri prirrti'ng dr bther densities'bf a cblbr image' c^lSured on a color neg- 
tographic ^(eim^ Which is' bptiirozed fbr''^)ftkiucirig^ a c6lbr Irnage surled for conversion to an elec^ 



producing] 
ative phbtogr; 

trbnic form arKi subsequerit recbrKfersion into a ^ ' " ^ v; , ;? - . « ; 

mapping said printing densities of ' feaid tligital coloi" negative image to the printing densities that would have 
' been obtained for refbrenc6 color negative photogifBphic element; ; ; • . - , 

• processing said mapped digital coloF hegative image with an underexposure scene balance algorithtn; 

miapprng said processed digital color negative 4mage through a hard copy media characteristic curve to pro- 
duce a digital color positive irniage; ' ^ V,!,; 

; sharpening said mapped digital color positive image with a sharpening algorithm optimized to avoid unaccept- 
able artifacts; and 

digitally printing said sharpened digital color image onto hard copy media. ^ . - 

10. The method of claim 9 wherein said processing step processes said mapped digital color image with one or both 
of an underexposure gamma correction algorithm and a contrast normalization algorithm in addition to said scene 
balance algorithm. 
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(57) A method of digital photofinishing. comprising 
the steps of: producing a digital color image in printing 
densities of a color image captured on alternative cap- 
ture photographic media; first mapping the printing den- 
sities of the alternative capture photographic media to 
the printing densities that would have been obtained for 
reference color photographic media; processing the 
mapped digital color image with a scene balance algo- 
rithm to produce a processed digital color Image; sec- 
ond mapping the processed digital color image through 
a hard copy media characteristic curve to produce a 
mapped digital color image mapped to print densities of 
the hard copy media; sharpening the mapped digital 
color image with a sharpening algorithm optimized to 
avoid unacceptable artifacts; and digitally printing the 
sharpened digital color image onto hard copy media. 
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